A DirectX-Based DICOM Viewer for Multi-user Surgical Planning in Augmented Reality

Preoperative medical imaging is an essential part of surgical planning. The data from devices, such as CT and MRI scanners, consist stacks 2D images in DICOM format. Conversely, advances 3D visualization provide further information by assembling cross-sections into volumetric datasets. As Microsoft unveiled the HoloLens 2 (HL2), which considered one best Mixed Reality (XR) headsets market, it promised to enhance providing immersive experience users. This paper introduces a prototype holographic XR Viewer for image sets on HL2 We first developed standalone graphical C++ engine using native DirectX11 API HLSL shaders. Based that, applies OpenXR potential deployment wide range devices vendors across spectrum. With access device, our unravels limitation hardware capabilities volume rendering interaction. Moreover, smartphones can act input another user interaction method connecting server. In this paper, we present viewer contribute (i) that renders real-time HL2, (ii) three types interactions XR, (iii) preliminary qualitative evaluation prototype.